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(57) ABSTRACT 

A centroid computation system is disclosed. The system has 
an imager array, a switching network, computation 
elements, and a divider circuit. The imager array has col- 
umns and rows of pixels. The switching network is adapted 
to receive pixel signals from the image array. The plurality 
of computation elements operates to compute inner products 
for at least x and y centroids. The plurality of computation 
elements has only passive elements to provide inner prod- 
ucts of pixel signals the switching network. The divider 
circuit is adapted to receive the inner products and compute 
the x and y centroids. 

15 Claims, 10 Drawing Sheets 
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HIGH-SPEED ON-CHIP WINDOWED 
CENTRO IDING USING PHOTODIODE- 
BASED CMOS IMAGER 

CROSS REFERENCE TO RELATED 
APPLICATION 

This application claims the benefit of the priority of U.S. 
Provisional Application No. 60/157,556, filed on Oct. 4, 
1999, and entitled Photodiode -based CMOS Active Pixel 
Sensor with Zero Lag, Low Noise and Enhanced Low- 
Light-Level Response; and U.S. Provisional Application No. 
60/157,211, filed on Sep. 30, 1999, and entitled Smart 
CMOS Imager with On-Chip High-Speed Windowed Cen- 
troiding Capability. 

ORIGIN OF INVENTION 

U.S. Government may have certain rights in this invention 
pursuant to NASA contract number NAS7-1407. 

BACKGROUND 

Accurate computation of a centroid from a pre -defined 
window in an image plane is desirable for a number of 
space-based and commercial applications. The applications 
may include object tracking in robotic systems, autonomous 
navigation, image compression, and document copyright 
protection. Other applications may include space guidance 
and navigation systems, and deep-space optical communi- 
cation systems that require accurate and stable beam point- 
ing for high speed data transfer. 

Off-focal-plane digital processors may yield accurate cen- 
troid values, but only at the cost of increased latency, power 
and size. On or near focal-plane centroid computation using 
current mode circuits, and neuro-MOS circuits have been 
implemented. However, neither approach may be compat- 
ibly integrated with high performance image sensors. 

A photodiode -based active pixel imager (API) sensor may 
be used for high quality imaging applications such as the 
centroid computation. The photodiode -based sensor pro- 
vides higher quantum efficiency than a photogate -based 
sensor. However, noise in the photodiode-type CMOS API 
sensors causes high reset (kTC) noise at the sense node. 

SUMMARY 

The present disclosure describes a centroid computation 
system having an imager array, a switching network, com- 
putation elements, and a divider circuit. The imager array 
has columns and rows of pixels. The switching network is 
adapted to receive pixel signals from the image array. The 
plurality of computation elements operates to compute inner 
products for at least x and y centroids. The plurality of 
computation elements has only passive elements to provide 
inner products of pixel signals the switching network. The 
divider circuit is adapted to receive the inner products and 
compute the x and y centroids. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Different aspects of the disclosure will be described in 
reference to the accompanying drawings wherein: 

FIG. 1 shows an embodiment of the windowed- 
centroiding active pixel sensor (APS) system; 

FIGS. 2 A and 2B illustrate circuits used for inner-product 
computations for the X- and Y-centroid blocks, respectively; 

FIG. 3 shows an embodiment a divider circuit; 

FIG. 4 shows a layout of a prototype imager of 128x128 
format according to an embodiment of the present disclo- 
sure; 


FIG. 5 shows a measured centroid error versus window 
size; 

FIG. 6 shows a plot of a centroid error as a function of 
average signal strength; 

5 FIG. 7 is a schematic diagram of a photodiode- type 
CMOS APS pixel according to an embodiment of the 
present disclosure; 

FIG. 8 is a timing diagram of an imager running in digital 
still mode; 

FIG. 9 shows a plot of a response non-linearity with the 
pixel held in reset state during idling phase; 

FIG. 10 is a SPICE simulation showing the sense node 
potentials for different sense node signal excursions as the 
15 pixel is periodically reset; 

FIG. 11 A shows a schematic of a flushed photodiode APS 
pixel in accordance with an embodiment; 

FIG. 11B shows a schematic of an HTS photodiode APS 
pixel in accordance with an embodiment; 

20 FIG. 12 shows pixel timing diagrams; 

FIG. 13 is a SPICE simulation showing the sense node 
potentials for different sense node signal excursions as the 
pixel is periodically reset; 

25 FIG. 14 shows a plot of measured photodiode APS pixel 
linearity; 

FIG. 15 shows a plot of measured image lag from 
different photodiodes; and 

FIG. 16 shows a plot of a noise as a function of the pixel 
30 conversion gain. 

DETAILED DESCRIPTION 

The present disclosure describes an on-focal plane cen- 
troid computation circuit that is compatible and integrated 
35 with CMOS imagers implemented in conventional or modi- 
fied CMOS technology. In the present disclosure, a 
photodiode-based CMOS active pixel sensor (APS) is 
described as an example of a CMOS imager that may be 
used. 

40 Overview 

The centroid computation circuit design allows accurate 
X- and Y-centroid computation from a user-selectable win- 
dow of interest. The circuit also allows window location and 
size to be programmable. The circuit may be designed to 
45 dissipate less power than the prior art designs, which may 
enable a real-time, miniature tracking system. In one 
implementation, the centroid computation circuit utilizes a 
switched capacitor network having only passive elements 
such as capacitors and switches. The circuit further allows 
50 column-parallel computation that enables X- and Y-centroid 
computations to be performed substantially simultaneously. 
This provides low power consumption and high accuracy 
computation to better than 0.05 pixel accuracy. The accuracy 
may be achieved under most lighting conditions, while 
55 maintaining high update rates (20-50 KHz) that make the 
chip attractive for use in real-time image-based control 
systems. 

The photodiode -based CMOS imager design provides 
improved steady state and dynamic response. In this design, 
60 both the pixel sensor and the clocking scheme are modified 
to allow imager operation with reset level independent of 
signal strength under steady state or dynamic conditions. 
The pixel is reset in “soft-reset” allowing low-reset noise 
and high power supply rejection ratio (“PSRR”). However, 
65 its steady state and dynamic response may be made to follow 
that obtained with “hard-reset”. Hence, the design provides 
substantially reduced image lag and high linearity even 
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under low-light levels compared to conventional imager 
designs. The image lag was measured to be less than 1% 
compared to 10% in conventional imagers with soft-reset. 
Further, no dead zone was found, with greater than 40 dB 
enhancement of low-light response. The present imager 5 
design also provides low noise and high PSRR. The noise 
was measured to be less than half the conventional devices 
with hard-reset. The PSRR was measured to be 40 dB higher 
than the hard-reset without bypass capacitor. 

Description for Embodiments of Windowed- Centroiding 
System 

An embodiment of the windowed-centroiding active pixel 
sensor (APS) system 100 is shown in FIG. 1. The system 
provides on-chip 2-D centroid computation. The system 
includes a 2-D imager array 102, a switching network 104, 
inner-product (IP) computation circuits 106, 108, and an 15 
analog divider 110. The 2-D computation is performed by 
computing the relevant inner-products or weighted sums for 
a given row. Upon completion of all row-wise inner- 
products, these values are processed to generate the final X 
and Y inner-products. A divider circuit 110 is then used to 20 
generate the X- 112 and Y-centroids 114. 

The X- and Y-centroids 112, 114 provided by the on-focal- 
plane circuits 102-110 are computed as follows: 


x nxn = 


2-(re+l) /=i j= 1 

M^Tj72i' ££ 

»'=1 J = 1 






Y nxn = - 


( "- 1) ESV* 

i=l 7=1 


[ 1 ] 2 5 


30 


35 


where x- and y .=1, 2, 3, . . . , n-1, respectively, and v~ is 
the voltage of each pixel. Both computations may yield 
the correct value of the respective centroids except for 
a scaling pre-factor. 40 

An embodiment of a circuit 200 used for inner-product 
computations for the X-centroid block 106 is shown in FIG. 
2A. An embodiment of a circuit 250 used for inner-product 
computations for the Y-centroid block 108 is shown in FIG. 

2B. Only capacitors and switches are used to perform the 45 
computation, with different sized capacitors representing 
different weights. The capacitors in the column-averaging 
banks 202, 252 are used for sampling one row of pixel 
values. The capacitors are linearly scaled in the X-centroid 
block, while they are the same in successively enabling 50 
clocks EN1, EN2, . . . EN(n-l) 254. Averaging over the 
columns, and sharing the result with one of the capacitors in 
the row-averaging bank 208, 258 is carried out by pulsing 
AVC 206, 256 and the appropriated DUMP(i) 210, 260 
substantially simultaneously. This allows equal but reduced 55 
attenuation for all row signals. The capacitors 262 in the 
row-averaging bank 258 are linearly scaled for the 
Y-centroid block 250, while the capacitors 212 are equal for 
the X-centroid block 200. 

In each of the illustrated embodiments, a switching net- 60 
work having an Nx9 (N is the imager format) switching 
array connects 9 consecutive columns of the imager array 
into the computation circuit. This allows centroid computa- 
tion for blocks of size 3x3 to 9x9. Thus, the computation is 
performed in parallel with the imager readout. This parallel 65 
computation allows for a high computation speed and sub- 
stantially reduced computational overhead. 


An embodiment shown in FIG. 3 may be used as the 
divider circuit 110. The circuit includes an op -amp 300 with 
a plurality of transistors 302 configured to generate the X- 
and Y-centroids from the row-wise inner products. 

FIG. 4 shows a layout of the prototype imager 400 of 
128x128 format. Computation circuits 402 take up only a 
small area (1.7 mmx0.9 mm), irrespective of the imager 
format. In the illustrated embodiment, the imager 400 is 
fabricated using HP 0.5 /um CMOS technology with a 12 j urn 
pixel pitch. The imager 400 has two ports: one for centroid 
output and the other for imager output. 

The performance of the illustrated imager 400 is summa- 
rized in Table 1. The Table shows imager performance 
exceeding that of conventional designs. As shown, the use of 
passive components and only one op -amp (for the divider 
circuit) enables low power operation on the order of about 
3 mW. 


TABLE 1 


Summary of the Centroid APS chip Characteristic 

Characteristics 

Value 

Format 

128 x 128 

Pixel Size 

12 jLim 

Technology 

HP 0.5 pan 

Power Supply 

3.3 V 

Saturation Level 

850 mV 

Conversion Gain 

25 

Read Noise 

9 e" 

Dark Current 

78 mV/sec 

Power 

3 mW 


In order to measure the centroiding accuracy, image 
centroid may be computed separately by acquiring the raw 
data from the imager port. The computed centroid may be 
compared against the value obtained from the centroid port. 
Relative error (in pixels) may then be computed. The 
measurements may be repeated for different window sizes, 
centroid values, mean signal strengths, and from different 
regions of the imager. The result indicates that a typical 
centroid error of 0.02 pixel may be achieved over most of the 
array. According to FIG. 5, the worst-case error was around 
0.07 pixel for the smallest sized (3x3) window. FIG. 5 also 
shows the smallest and the largest centroid error measured 
from the array. The error dependence on the window size 
was not large, although in general, the error is found to be 
lower for larger sized windows. 

With present design of the centroid computation circuit, 
high update rates may be obtained without compromising 
centroiding accuracy. Update rates vary from 20 to 50 KHz 
for window sizes scaling from 9x9 to 3x3. The total noise 
added by all three centroid computation circuits is small 
compared to the imager output r.m.s. noise of 225 jiiV (-9 
e"). This is achieved by increasing capacitor sizes, with 
minimum being 2 pF. Large capacitance size also helps to 
minimize capacitance -matching errors. Residual error in the 
circuit is governed by matching errors and switch feed- 
through. Hence, as shown in FIG. 6, the centroiding inac- 
curacy tends to increase for mean signals less than 100 mV. 
The residual error also increases for larger mean signal 
(-800 mV), due to non-linearities and signal saturation. 
Description for Embodiments of Photodiode -based CMOS 
Imager 

As stated above, a photodiode -based CMOS active pixel 
sensor (APS) may be used as a CMOS imager that provides 
image signal input for the centroiding computation. FIG. 7 
shows an embodiment of a photodiode -based APS pixel 700. 
Signal integrated on the photodiode sense node (SENSE) 
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702 is calculated by measuring the difference between the 
voltage on the column bus (COL) 704, before and after the 
reset (RST) 706 is pulsed. Other pixels 708, 709 may be 
connected to the same column bus 704. 

In the illustrated embodiment of FIG. 7, lower kTC noise 5 
may be achieved with photodiode -type pixels by employing 
“soft-reset” technique. The soft-reset includes resetting the 
pixel with both drain and gate of the n-channel reset tran- 
sistor 710 kept at the same potential. This results in the sense 
node 702 being reset using sub-threshold MOSFET current. 
However, the noise may be lowered at the expense of higher 
image lag and low-light-level non-linearity. The noise 
behavior is analyzed and the evidence of degraded perfor- 
mance under low-light levels is shown below. Further, a new 
pixel design that substantially reduces non-linearity and 
image lag without compromising noise is presented. 15 

The reset noise at the sense node 702 may be estimated 
from the time -dependence of the probability distribution 
function (F n ), defined as the probability of finding n elec- 
trons on the sense node at a particular moment. In weak- 
inversion, the current is given by 20 

q- AV 

/ = e 'mkT f 

where DV is the voltage difference between W GS (or V 5jD ) 25 
and the threshold voltage (V r ), KT/q is the thermal potential 
(+ r ), and m is the non-ideality factor. Since V z?5 »(|) r , the 
reverse current is minimal. This makes the current flow 
substantially unidirectional. Then, ^ 

dF n _ [ 1 ] 

n ~ ^n-iSn-i r n g n . 


where g„, is the probability per unit time of adding an 35 
electron in presence of n electrons. The variance in the 
average number of electrons (n) on the sense node can 
be computed from equation 1 to provide: 

^! = l + 2^V. [2] 40 

dh dt g 

For weak-inversion condition, g n «e _pn , where 

45 

H mkTC 


Equation 2 may then be solved to provide: 


50 


x 2 = — [1 - e~ 2 ^ n + 2 /3e- 2/3An o 


[3] 


where a 2 is the variance at the onset of the reset process, 55 
and An is the average amount of electrons added to the 
sense node. For a photodiode type APS under soft- 
reset, a 2 = 0 for a given frame, and 


An 

mkTC / 2 


for ■ An 1 | 

for ■ An 1 J 


[4] 60 


In other words, if the amount of charges added is small, 
reset noise is determined by the shot-noise in the amount of 65 
electrons. Thus the reset noise may be substantially smaller 
than kTC. On the other hand, if An is large, reset noise 


approaches mkTC/2. If m=l, there is a factor of two reduc- 
tion in variance for soft-reset. 

The reduction in reset noise may be caused by the 
feedback inherent to the reset mechanism. For an exponen- 
tial current flow over the barrier, instantaneous current flow 
may decrease sooner if there is an increase in the node 
potential. As a result, the distribution of electrons narrows as 
the reset (under weak-inversion) progresses. This causes 
sub -kTC reset noise. Further, since the reverse current is 
negligible, the interaction between power supply fluctua- 
tions and the sense node 702 may be significantly reduced. 
This allows the soft reset to provide high PSRR. 

The soft-reset affects imager behavior both under steady - 
state and dynamic conditions. For example, FIG. 8 illus- 
trates a timing diagram (for still imaging mode) showing the 
reset (RST) pulse 800 and the signal (SHR) pulse 802 
indicating when the reset level is sampled. Keeping the RST 
800 high during the idle phase (t idle ) enables flushing of 
unwanted charges, but steady-state linearity is substantially 
degraded. The response non-linearity is a result of the 
weak-inversion current that causes SENSE node 702 to 
charge up in a slow logarithmic manner during the idle 
phase. If the current during the integration phase (t inf ) is 
small, SENSE node 702 may not be discharged enough for 
the subsequent reset to affect the potential of the SENSE 702 
node. Consequently, the difference between the signal and 
the reset levels significantly decrease for small signals 
thereby causing response non-linearity at low-light levels. 
Furthermore, under soft-reset, actual reset levels may vary 
depending upon the signal in the previous frame. The actual 
signal may be calculated by the computed difference 
between the potential on the sense node before and after 
reset. Thus, variation of the reset level results in steady-state 
non-linearity due to modulation of the reset level by the 
average signal strength. Under dynamic lighting conditions, 
the reset level will vary from one frame to another depend- 
ing upon the signal integrated in the previous frame. The 
variation of the reset levels between successive frames is the 
measure of image lag. Thus, both steady-state and dynamic 
response are degraded with soft-reset, even though it results 
in lower reset noise. 

FIG. 9 shows the response measured from a large format 
(e.g. 512x512) imager operated with the timing shown in 
FIG. 8. The response “dead-zone” may be seen for low- light 
levels. The dead-zone may be substantially reduced by 
holding the reset low during i idle . This may prevent biasing 
of the reset transistor in deep sub-threshold condition. 
However, the response non-linearity at low-light levels may 
still be significant. This is illustrated in the SPICE simula- 
tion results of FIG. 10. FIG. 10 plots the simulated potential 
variations of the SENSE node 702 as the node is periodically 
reset for different voltage excursions during the reset OFF 
state. The result indicates that the actual reset level is higher 
by more than 30 mV under low-light-levels. This causes an 
order of magnitude increase in non-linearity at steady -state. 
Under dynamic lighting conditions, the reset level may vary 
from one frame to another depending upon the signal 
integrated in the previous frame. 

FIGS. 11A and 11B show the flushed 1100 and the 
hard-to-soft (HTS) 1150 photodiode APS pixels, 
respectively, in accordance with an embodiment of the 
present disclosure. The flushed photodiode pixel 1100, 
shown in FIG. 11 A, includes of an additional line (HTS) 
1102 that controls the potential at the drain 1104 of the reset 
transistor. The HTS photodiode APS 1150 (FIG. 11B) has 
the same pixel design as that of the flushed APS pixel 1100. 
However, the power supply (V dd ) 1156 is routed to each 
column 1158 through an n- 1152 or p-channel 1154 transis- 
tor. 
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FIG. 12 shows a timing diagram of a pixel. HTS is a 
row-decoded signal for the flushed photodiode pixel 1100, 
and it is a common signal for the HTS pixel. Momentarily 
pulsing HTS with the reset (RST) pulse ON causes the pixel 
to be reset first in hard-reset, followed by a soft-reset. For the 
HTS pixel, the hard-reset level is determined by the sizing 
of the transistors, and is set to approximately V 2 'W dd . 

The hard reset erases the pixel memory. Thus, the soft- 
reset level reaches the same level irrespective of the photo - 
signal strength, as shown in PS PICE simulations in FIG. 13. 
Unlike in FIG. 10, the soft-reset level no longer depends 
upon voltage excursions at SENSE node. HTS mode of 
operation does not affect the reset noise. Since equation 3 
indicates that as long as An is large, the contribution from the 
initial variance (due to hard-reset in this case) is low. 
Therefore, the imager performance does not depend upon 
the actual value of the hard-reset level. 

A 128x128 test imager with 12 jum pixels was designed 
and fabricated in 0.5 /um CMOS technology to verify the 
concept. The imager includes different pixels to allow inves- 
tigation of four different modes of operation: soft-reset, 
hard-reset, HTS, and flushed. FIG. 14 shows the measured 
response linearity with the imager operated in double delta 
sampling mode. The results demonstrate that the imager 
operated in soft-reset mode exhibits significant low-light 
level non-linearity. The results also indicate that the non- 
linearity is undetectable in the other three modes down to the 
read noise levels (-250-400 juV r.m.s.). 

FIG. 15 shows that the image lag is high (-2%) for large 
signals (in the previous frame). The image lag drops sharply 
to less than 1% for smaller signals. However, the image lag 
is undetectable for the other three operating modes. 

The measured noise for hard-reset and HTS mode of 
operations is shown in FIG. 16. The noise performance 
closely follows the model, with the noise for hard-reset 
mode being given by ^kTC, and less than A).5kTC for HTS 
mode. 

While specific embodiments of the invention have been 
illustrated and described, other embodiments and variations 
are possible. 

All these are intended to be encompassed by the following 
claims. 

What is claimed is: 

1. A centroid computation system, comprising: 

an imager array having columns and rows of pixels; 

a switching network adapted to receive pixel signals from 
said image array; 

a plurality of computation elements coupled to said 
switching network to receive pixel signals and operat- 
ing to compute inner products for at least x and y 
centroids, said plurality of computation elements hav- 
ing only passive elements without an amplifier to 
provide inner products of pixel signals from said 
switching network; and 

a divider circuit coupled to said computation elements and 
adapted to receive said inner products and compute said 
at least x and y centroids. 

2. The system of claim 1, further comprising: 

a block averaging circuit receiving said pixel signals and 
averaging said pixel signals over said columns. 

3. The system of claim 1, wherein said plurality of 
computation elements include switches and capacitors. 

4. The system of claim 3, wherein said plurality of 
computation elements include row-averaging banks and 
column- averaging banks. 


8 

5. The system of claim 4, wherein said capacitors in said 
row- averaging banks are substantially similar in value. 

6. The system of claim 4, wherein said capacitors in said 
row- averaging banks are linearly increasing in value. 

5 7. The system of claim 1, wherein said divider circuit 

includes an op-amp and a transistor in a feedback path of the 
op- amp. 

8. The system as in claim 1, wherein said imager array is 
a CMOS active pixel sensor array, the system further com- 

10 prising a semiconductor substrate on which said imager 
array is formed and integrated, wherein said switching 
network, said computation elements, and said divider circuit 
are formed and integrated on said substrate with said imager 
array to allow for on-chip centroid computation. 

15 9. The system as in claim 8, wherein each pixel includes 

a photodiode responsive to received radiation to produce 
charge. 

10. The system as in claim 9, wherein said photodiode 
includes: 

20 a sensing node to output said charge; 

an output transistor having a gate coupled to said sensing 
node to produce a pixel signal representing said charge; 
and 

a reset transistor having a source formed from said 
sensing node, a gate coupled to receive a reset signal, 
and a drain coupled to a separate reset control signal 
which is pulsed on and off when said reset signal 
remains on to reset said sensing node and to erase a 
memory in said photodiode from a previous readout 

30 cycle. 

11. The system as in claim 1, wherein said switching 
network is configured and coupled to said imager array to 
connect a plurality of columns of pixels in parallel to said 
computation elements for parallel processing. 

35 12. A system having an imager array, comprising: 

a substrate; 

an imager array integrated on said substrate and formed of 
CMOS active pixel sensors; 

40 a switching network integrated on said substrate and 
coupled to said imager array to receive pixel signals 
from said image array; 

at least one centroid computation circuit integrated on 
said substrate and coupled to said switching network to 

45 compute inner products for at least x and y centroids, 
said at least one centroid computation circuit having 
only passive elements without amplifiers to provide 
inner products of pixel signals from said switching 
network; and 

50 a divider circuit integrated on said substrate and adapted 
to receive said inner products and compute said at least 
x and y centroids. 

13. The system of claim 12, further comprising: 

a block averaging circuit, integrated on said substrate, 

55 receiving said pixel signals and averaging said pixel 
signals over said columns. 

14. The system as in claim 12, wherein said switching 
network is configured and coupled to said imager array to 
connect a plurality of columns of pixels in parallel to said at 

60 least one centroid computation circuit for parallel process- 
ing. 

15. The system as in claim 12, wherein said least one 
centroid computation circuit includes capacitors that carry 
out centroid computations. 

65 



